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Abstract 

This is the first part of a paper that studies the phase transition in the asymp- 
totic hmit of the rank 1 real Wishart spiked model. In this paper, we consider 
A^-dimensional real Wishart matrices S in the class (S, M) in which all but one 
eigenvalues of S is 1. Let the non-trivial eigenvalue of S be 1+r, then as A^, M — )• oo, 
with N/M = 7^ finite and non-zero, the eigenvalue distribution of S will converge 
into the Machenko-Pastur distribution inside a bulk region. As r increases from zero, 
one starts seeing stray eigenvalues of S outside of the support of the Machenko-Pastur 
density. As the first of these stray eigenvalues leaves the bulk region, a phase tran- 
sition will occur in the largest eigenvalue distribution of the Wishart matrix. In this 
paper will compute the asymptotics of the largest eigenvalue distribution when the 
phase transition occur. In the this first half of the paper, we will establish the results 
that are valid for all N and M and will use them to carry out the asymptotic analysis 
in the second half of the paper, which will follow shortly. In particular, we have de- 
rived a formula for the integral /q^^y^ ^-^^(^gYa ^g'^dg when X, Y are symmetric and 
y is a rank 1 matrix. This allows us to write down a Fredholm determinant formula 
for the largest eigenvalue distribution and analyze it using orthogonal polynomial 
techniques. This approach is very different from a recent paper [10], in which the 
largest eigenvalue distribution was obtained using stochastic operator method. 

1 Introduction 

Let X be an X M (throughout the paper, we will assume M > N and N is even) matrix 
such that each column of X is an independent, identical A^-variate random variable with 
normal distribution and zero mean. Let E be its covariance matrix, i.e. Sjj = E[XiiXji). 
Then S is an x positive definite symmetric matrix and we denote its eigenvalues by 
l+Tj. The matrix 5* defined by S* = j^XX'^ is a real Wishart matrix in the class PVr (S, M). 
We can think of each column of X as a draw from a X-variate random variable with the 
normal distribution and zero mean, then S is the the sample covariance matrix for the 
samples represented by X. Real Wishart matrices are good models of sample covariance 
matrices in many situations and have applications in many areas such as finance, genetic 
studies and climate data. (See for example.) 
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In many of these applications, one has to deal with data in which both and M are 
large, while the ratio N/M is finite and non-zero. In particular, in applications to principle 
analysis, one would like to study the asymptotic behavior of the largest eigenvalue of S as 
A^, M oo with M/N -> 7^ > 1 fixed. 

For many statistical data, it was noted in [21j that in the asymptotic limit, the eigen- 
value distribution of the sample covariance matrix will converge to a distribution whose 
density is given by the Machenko-Pastur law [23] inside a bulk region (See [1],[5].) 

p(A) = ^v/(A -&-)(&+ -A)x[._,,,], (1.1) 

where X[b-,b+] is the characteristic function for the interval and 6± = (1 ± 7~^)^. 

However, outside of the bulk region, there are often a finite number of large eigenvalues 
at isolated locations. This behavior prompted the introduction of the spiked model in 
|21] . which are Wishart matrices with a covariance matrix with all but a finite number 
of eigenvalues that are not equal to one. These non-trivial eigenvalues in the covariance 
matrix will then be responsible for the spikes that appear in the eigenvalue distribution of 
the sample covariance matrix. The number of these non-trivial eigenvalues in E is called 
the rank of the spiked model. 

Of particular interest is a phase transition that arises in the largest eigenvalue distri- 
butions when the first of these spikes starts leaving the bulk region. This phenomenon 
was first studied in ^ for the complex Wishart spiked model and then in [21] for the 
rank 1 quarternionic Wishart spiked model. Despite having the most applications, the 
asymptotics for real Wishart spiked model has not been solved until very recently [TO] . 
The main goal of this paper is to obtain the largest eigenvalue distribution for the rank 1 
real Wishart spiked model in the asymptotic limit. In a recent paper [TD], the asymptotic 
largest eigenvalue distribution for the rank 1 real Wishart ensemble was obtained by using 
a completely different approach to ours. In [10], the authors first use the Housefolder al- 
gorithm to reduce a Wishart matrix into tridiagonal form. Such tridiagonal matrix is then 
treated as a discrete random Schrodinger operator and by taking an appropriate scaling 
limit, the authors obtained a continuous random Schrodinger operator on the half-line. By 
doing so, the authors in [10] bypass the problem of determining the eigenvalue j.p.d.f. for 
the real Wishart ensemble and obtain the largest eigenvalue distribution in the asymptotic 
limit. 

On the other hand, the approach presented in this paper uses orthogonal polynomial 
techniques that are closer to those in [7] and [21] • We will now outline our method. 

One of the main difficulties in the asymptotic analysis of the real Wishart ensembles is 
to find a simple expression for the j.p.d.f. of its eigenvalues. Let \j be the eigenvalues of 
the Wishart matrix, then the j.p.d.f. for the real Wishart ensemble is given by 

P(A) = y^|A(A)| n / e-f-(--^^-^-^)/rf,, (1.2) 

^M.AT Jo{N) 
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where g^dG is the Haar measure on 0{N) and Zm,n is a normahzation constant. The 
expression of the j.p.d.f. for the complex and quarternionic Wishart ensembles are similar. 
In the complex case, the integral in the j.p.d.f. will be over the unitary group while in 
the quarternionic case, the integral will be over the symplectic group. One of the main 
difficulties in the asymptotic analysis of Wishart ensembles is to evaluate the integral in 
(11. 2p . In the complex case, this integral can be evaluated using the Harish-Chandra [TTj (or 
Itzykson Zuber [19]) formula, while in the quarternionic case, the integral can be written 
as an infinite series in terms of Zonal polynomials and such series converges to a simple 
function in the rank 1 case. For the real case, however, the Harish-Chandra Itzykson Zuber 
formula does not apply and while the series expression in terms of Zonal polynomials still 
exists, such series expression do not seem to converge into a simple function. In fact, 
our first result is that the integral over 0{N) in (II. 2p is a hyper-elliptic integral in the 
eigenvalues Ai, . . . , Atv- 

Theorem 1. Assuming N is even. Let the non-trivial eigenvalue in the covariance matrix 
S be 1 + T. Then the j.p.d.f. of the eigenvalues in the rank 1 real Wishart spiked model 
with covariance matrix S is given by 

N 

r ___ Af-iV-l / T- \ 2 



r 



where T is a contour that encloses all the points 2{i+t) "^i' ■ ■ ■ ' 2(i+t) ^^^^ ^'^ oriented in 

the counter-clockwise direction and Zm,n is the normalization constant. The branch cuts 

_ 1 

of the square root — 2(7+1)^) ^ ^■^ chosen to be the line arg(t — 2(7+1)^) ~ ^■ 

We will present two different proofs of this in the paper. The first one is a geometric 
proof which involves choosing a suitable set of coordinates on 0{N) and decompose the 
Haar measure into two parts so that the integral in (11.21) can be evaluated. This will be 
achieved in Sections |2] and [31 The second proof is an algebraic proof that uses the Zonal 
polynomial expansion to verify the formula in Theorem [T] This proof will be given in 
the Appendix where integral formulae of the form (II. 3p for the complex and quarternionic 
Wishart ensembles will also be derived. 

Remark 1. The integral formula derived here is very similar to a more general formula 
in l^, in which the matrix integral over 0{N) is given by 

f e-H^aY9-^)gT^g ^ f ^ ^''^'^ 

Jo{N) J n,=i det(S' - yjX) 



where the integral of S is over a/— 1 times the space of N x N real symmetric matrices and 
yj are the eigenvalues ofY. The measure dS is the flat Lebesgue measure on this space. 
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From the expression of the j.p.d.f., we see that the largest eigenvalue distribution is 
given by 

a.<z)= [ ... f P(A)dAi...dA^, 

JAi<...<Aiv<2 J 

ZkIn / e''* / . . . / |A(A)| n «;(A,)dAi . . . dX^dt 



where w{x) is 



Af„ M-iV-1 



w{x) = e 2 ""x 2 t -x] (1.5) 

V 2(1 + r) J 

and r is chosen such that it intersects (0, oo) encloses the interval [0, z\. 

We can analyze the integrand as in [28], [29] and [30]. By an identity of Brujin [11], we 
can express the multiple integral as a Pfafiian. 

N 

... |A(A)in^(A,)dAi...dA^ 

Ai<...<Ajv<J/ J j=i (l-O) 

= Pf (((1 - X[2,oo))rj(x), (1 - X[z,oo))rk{y))^ ■ 

where rj{x) is an arbitrary sequence of degree j monic polynomials and {f,g)i is the skew 
product 

/•oo /"OO 

if, 9)1= / e(a; - y)/(a;)fi'(y)w^(a;)w(2/)dxd?/. (1.7) 
Jo Jo 

where e{x) = ^sgn{x). In defining the skew product, the contour of integration will be 
defined such that if t is too close to (0, 00), then the interval (0, 00) will be deformed 
appropriately into the upper or lower half plane such that the integral is well defined. Such 
deformation will not affect the value of the Pfaffian as F will not intersect the integration 
paths on the left hand side of fll.6p . Then by following the method in [2B], [2S] and [3D], 
we can write the Pffafian as the square root of a Fredholm determinant. Let Ai be the 
moment matrix with entries {rj,rk)^, then we have 

Pf (((1 - X[z,oo)){x)r,{x), (1 - Xlz,oo)){y)rk{y)),) = Vdet M{t)^J det [l - Kx[z, 00)), 
where K is the operator whose kernel is given by 

A-(-.y)=ff'*"''> -ff<Y') (1.8) 

\ISi{x,y) Si{y,x) J 
and Si{x,y) and ISi{x,y) are the kernels 

N-l 



Siix,y) = - ^ rj{x)w{x)njk<^{rkw){y), 



(1.9) 

N-l ^ ' 



ISi{x,y) = - ^ e{rjw){x)iJ,jke{rkw){y) 

j,k=0 
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and fijk is the inverse of the matrix Ai. As shown in [32], the kernel can now be expressed in 
terms of the Christoffel Darboux kernel of some suitable orthogonal polynomials, together 
with a correction term which gives rise to a finite rank perturbation to the Christoffel 
Darboux kernel. In this paper, we introduce a new proof of this using skew orthogonal 
polynomials and their representations as multi-orthogonal polynomials. By using ideas 
from [1] to write skew orthogonal polynomials in terms of orthogonal polynomials, we can 
express the skew orthogonal polynomials with respect to the weight w{x) in terms of a sum 
of Laguerre polynomials. Let 7Tk,i be the monic skew orthogonal polynomials with respect 
to the weight w{x). 

{7i2k+i,uy'), = (vr2M,Z/'>i = 0, J =0,...,2fc-l. (1.10) 
Then we can write these down in terms of Laguerre polynomials. 
Proposition 1. Let he the monic Laguerre polynomials respect to the weight Wq{x) 

Lk{x)L j{x)wQ{x)dx = SjkhjQ, Wo{x) = x^~^ e~^^^ . 

If {L2k-i, L2k-2)i 7^ 0, then the skew orthogonal polynomials TT2k,i ond 7r2fc+i.i both exist and 
TT2k,i is unique while 7!'2k+i,i is unique up to an addition of a multiple of TT2k,i- Moreover, 
we have {L2k, L2k-i)i = and the skew orthogonal polynomials are given by 

_ J- {L2k, L2k-2)i J 

T^2k,l — J^2k — 77 p T— -'^2fc-l; 

\J^2k-l-) J-'2k-2li 

_ J {L2k+1, L2k-2) I J {L2k+1, L2k-l) I J 

7r2fc+l.l — ^2k+l — 77 J ^^2k-l + 77 J r— -t>2fc-2 + CT^2k,l, 

W2fc-1, -t^2fc-2/i W2fc-1, -t^2fe-2/i 

where c is an arbitrary constant. 

Next, by representing skew orthogonal polynomials as multi-orthogonal polynomials 
and write them in terms of the solution of a Riemann-Hilbert problem as in |26], we can 
apply the results of [15] and [6] to express the kernel Si{x,y) as a finite rank perturbation 
of the Christoffel Darboux kernel of the Laguerre polynomials. 

Theorem 2. Let Si{x,y) defined by U.9\) and choose the sequence of monic polynomials 
rj{x) such that rj{x) are arbitrary degree j monic polynomials that are independent on t 
and rj{x) = vrj,i(x) for j = N — 2, N — 1. Then we have 



Si{x,y) - K2ix,y) 



U \ I 2ftt-^io ^ f L2N-2{x)\ , ^ (1-11) 

e(7r^+i,iM; 7r^,iw) [y) \ Mf Mt-f(M+jV) I U^jv-i x ) 
where K2{x,y) is the kernel of the Laguerre polynomials 

K2{x,y) = ( ' wlix)wky)'''^^^^''^-'^y^ " ^-(^)^--(-) 



x{t-Tx)J hN-ifl{x-y) 
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Note that the correction term on the right hand side of (11. lip is the kernel of a finite 
rank operator. Its asymptotics can be computed using the known asymptotics of the 
Laguerre polynomials and the method in [12] and [H]. The actual asymptotic analysis of 
this correction term, however, is particularly tedious as one would need to compute the 
asymptotics of the skew orthogonal polynomials up to the third leading order term due 
to cancelations. To compute the contribution from the determinant det A^, we derive the 
following expression for the logarithmic derivative of det A4 . 

Proposition 2. Let Ai be the moment matrix with entries {rj,rk)^, where the sequence of 
monic polynomials rj{x) is chosen such that rj{x) are arbitrary degree j monic polynomials 
that are independent on t and r.j{x) = TTj^i{x) for j = N — 2, N — 1. Then the logarithmic 
derivative of det Ai with respect to t is given by 

d , , , , f Si(x,x) , , , 

— logdetA^= / L U x, 1.12 

This then allows us to express the largest eigenvalue distribution "^{Xmax < z) as an 
integral of Fredholm determinant. 

Theorem 3. The largest eigenvalue distribution of the rank 1 real Wishart ensemble can 
he written in the following integral form. 

P(A^ax <z) = C [ exp(Mt+ [ [ ^l^^l^dxds] Jdet {l - Kx[z,oo))dt. (1.13) 
Jr \ Jco Jr+ s — tx /V 

for some constant Cq and K is the operator with kernel given by / fi.g|) . The integration 
contour T is a close contour that encloses the interval [0, z\ in the anti- clockwise direction. 

In the asymptotic limit, we will be able to evaluate the t integral in fll.l3p using steepest 
descent analysis. We shall see that the phase transition occurs when the saddle point in t is 

2 

such that the singularity t/r in the weight w{x) lies within a distance of order A^~3 to the 
end point 6+ in fll.ip . In this case, the factor (t — fx)~2 in the weight w{x) will significantly 
alter the behavior of the correction term in (11. lip and gives us a phase transition in the 
largest eigenvalue distribution. 

In this first part of the paper, we shall carry out the analysis when and M are 
finite and establish the results that are needed in the asymptotic analysis. Throughout the 
paper, we shall assume that is even and that M — N > 

2 Haar measure on SO{N) 

In this section, we will find a convenient set of coordinate on 0{N) to evaluate the integral 

Jo(N) 
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that appears in the expression of the j.p.d.f. (11 ■2p . As both and S are symmetric 
matrices, they can be diagonahzed by matrices in 0{N). We can therefore replace both 
and S by the diagonal matrices and A^. 

= diag ( T^^,---,Txr 

V 1 + Ti 1 + Tn, 

Ad = diag(Ai, . . . , Xn) 

The group 0{N) has two connected components, SO{N) and 0^{N) that consists of 
orthogonal matrices that have determinant 1 and —1 respectively. Let T be the matrix 






1 



















In-2 



then the left multiplication by T defines an diffeomorphism from 0^{N) to SO{N). In 
particular, we can write the integral over 0{N) in (ll.2p as 

Jo{N) 

SO{N) Jo-{N) 

SO(N) JsO{N) 

JsO{N) JsO{N) 

where is the diagonal matrix with the first two entries of swapped. 



E . ^ = diag 



1 1 1 



1 + T2 1 + ri 1 + Tat ^ 

Note that g^dg is also the Haar measure on SO{N). 

As we are considering the rank 1 spiked model, we let Ti = . . . = r^v-i = and = r. 
Therefore E^ = E^ and we have 



/(E, A) = 2 / e-f (2.i: 

JsO(N) 



'SO{N) 

Let gij be the entries of g E SO{N). Then the integral / can be written as 



J(E, A) = 2 / e~f , 

JsO(N) 



)(7V) 

e-ft'^((^d'-^iv)9Ad9-i)g-ftr(5A,g-i)^T^^^ 



SO(N) 



N „ 

nM \ / _rJU_ v^JV % 2 rp ^ 

e--^W e 2(1+-) ^^^i ^^j'v 5(^^51, 

j=l JsOiN) 
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We will now find an expression of the Haar measure that allows us to compute the integral 
/(S,A). 

First we will define a set of coordinates on SO{N) that is convenient for our purpose. 
We will then express the Haar measure on SO{N) in terms of these coordinates. 
An element g G SO{n) can be written in the following form 



g = {gi,- ■ ■ ,gn) , l^d = i> gi-gj = Sij, hj 



,n. 



This represents SO{N) as the set of orthonormal frames in with positive orientation 
whose coordinate axis are given by the vectors gi. As the vector is a unit vector, we 
can write its components as 

i-i 

giN = cos(f)i, 5fjAr = ]^sin(/)fcCOS(/)j, j = 2,...,n-l, 

*^=' (2.2) 

N-l ^ ' 



gNN = Yl 



k=l 

The remaining vectors gi, ■ ■ ■ ,gN-i form an orthonormal frame with positive orientation 
in a copy of R^~^ that is orthogonal to gN- Therefore the set of vectors gi, . . . , gN-i 
can be identified with SO{N — 1). To be precise, let u be a unit vector in and let 
G{u) G SO{N) be a matrix that maps u to the vector (0, ... ,0, 1)"^. Then since G is 
orthogonal, we have 

G{gN)gj = ivju...,Vj^N-uOf , j<N (2.3) 

In particular, the matrix V whose entries are given by Vij for 1 < i,j < — 1 is in 
SO{N — 1). A set of coordinates on SO{N) can therefore be given by 

g = {gN,v). (2.4) 

In the above equation, g^ is identified with the coordinates (pj in (12.21) . while the matrix 
V identify with the coordinates on SO{N — 1) that correspond to V. In terms of these 
coordinates, the left action of an element S G SO{N) on g is given by the following. 

Sg = {Sgi, SgN-i, Sg^)'^ 

= {SG{gNy^vi, SGi^gNy-^VN^i, SgN)^ 
Then as in (12. 3p . we have 

G{SgN)SG{gN)~^Vj = (vji, vj^n-i, 0)^ . 

The matrix V whose entries are given by Vij are again in SO{N — 1), therefore the matrix 
G{SgN)SG{gN)~^ is of the form 

GiSg^)SG{g^)-' = (2.5) 
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From the fact that G{SgN)SG{gN) ^ is an orthogonal matrix, it is easy to check that 
s = and sn = ±1. To determine sn, let us consider the action of G{SgN)SG{gN)~^ on 
(0,0,..., 1)^. We have 

GiSgr,)SGigr,)-\0, 0, . . . , 1)^ = GiSgN)Sgr, = (0, 0, . . . , 1)^ 

Therefore sat = 1 and Sn-i is in SO{N — 1). The action oi S on g is therefore given by 

Sg=(^SgN,SN-iVy (2.6) 

We will now write the Haar measure on SO{N) in terms the coordinates fl2.4p . These 
coordinates give a local diffeomorphism between SO{N) and S'^~^ x SO{N — 1) as gj\f G 
5^"^ and V G SO{N — 1). Let dX be a measure on 5*^"^ that is invariant under the action 
of SO{N) and V^dV be the Haar measure on SO{N — 1), then the following measure 

dH = dX A V^dV, 

is invariant under the left action of SO{N). Let 5* G SO{N), then its action on the 
point {(jN, V) is given by (12. 6p . where Sn-i depends only on the coordinates (pi, ... , (pN-i- 
Therefore under the action of S, the measure dH becomes 

dH ^dX A V^Sl_iSN-idV = dX A V^dV, (2.7) 

as dX is invariant under the action of S. Therefore if we can find a measure on 5^^^ that is 
invariant under the action of SO{N), then dX AV'^dV will give us a left invariant measure 
on SO{N). Since the left invariant measure on a compact group is also right invariant, this 
will give us the Haar measure on SO{N). As the metric on S"^"^ is invariant under the 
action of SO{N), it is clear that the volume form on S^~^ is invariant under the action of 
SO{N). Let dX be the volume form on S'^~^, then from (12. 7p . we see that the measure 
dX A V'^dV is invariant under the action of SO{N). 

Proposition 3. Let dX be the volume form on S'^~^ given by 

dX = sin^-2(0i) sin^-i(02) • • • sin(0jv-2) Af=i d^j 

in terms of the coordinates 0i,...,0Ar_i in li2.S\) and ^2.4^ , then the Haar measure on 
SO{N) is equal to a constant multiple of 

dH = dX A V^dV, 

where V'^dV is the Haar measure on SO{N — 1) in terms of the coordinates Iji2.4\ )- 
We can now compute the integral /(S,A). 
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3 An integral formula for the j.p.d.f. 

By using the expression of the Haar measure derived in the last section, we can now write 
the integral /(E,A) as 



/(S, A) = 2 TT e"^^^ / e^^) ^^=^ ^'^^^g^dg, 
^.^1 Jso(N) 

N „ r M N 2 

JsO(N-l) is^-i 
AT „ 

nM % / tM v^JV , 2 

g-^^i / (,2(1+^ 22^ = 1 ^jd^NfiX, 

7 = 1 -^S^-^ 



for some constant C, where the N — 1 sphere 5" in the above formula is defined by 
YljLi 9jN — 1 is the volume form on it. If we let gjN — Xj, then the above can be 

written as 

/(E,A) = 2CjJe-^^^ / e^^^='^'''h J^a;^ - 1 dxi...dxN. (3.1) 

j=i J^'^ \j=i J 

This can be seen most easily by the use of polar coordinates in M^, which are given by 

xi — r cos 01, Xj = r JJ^ sin (p^ cos (pj, j = 2, . . . , N — 1, 

k=i 

N-l 

fe=i 

Then the volume form in is given by 

dxi . . . dxN = r^~^ sin"^"^ 4>\ ■ ■ ■ sin 0Ar_2(ir(i0i . . . d(pN-i 
Therefore in terms of polar coordinates, we have 



N 



/■TT /■27r p2ir poo / 

= / d0i / (i02 ■ ■ ■ / #Ar-i / o?r(5 ^ 
io io ^0 Jo \j=l 



- 1 r^-i 



X e2(i+-) ^^=1 sm^"^ 01 . . . sm (f)N-2 



f tM V^AT ^ 2 

^ / g 2(1+7) 2.,=iA,a;.^^_ 
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To compute the integral /(S, A), we use a method in the studies of random pure quantum 
systems [21]. The idea is to consider the Laplace transform of the function /(S, A, t) defined 
by 

/(S, A, t) = 2CY\ e'^^^ / ^'""h V a;^ - t Uxi . . . dxN, 

7=1 -^^^ V^^ / 

then /(S, A, 1) = J(S, A). The Laplace transform of /(S, A, t) in the variable t is given by 

Jo jJi^ Jri^ 

Then, provided Re(s) > maxj (Aj), the integral can be computed explicitly to obtain 

I e-''m,A,t)dt = 2Cl[e-f'^ " 2(rT7) 
Taking the inverse Laplace transform, we obtain an integral expression for /(S, A). 

where F is a contour that encloses all the points 2{i+t) -^^^ • • • ' 2(i+r) ^^^^ oriented in 
the counter-clockwise direction. Rescaling the variable s to s = Mt, we obtain 

dt. 



This then give us an integral expression for the j.p.d.f. 

Theorem 4. Let the non-trivial eigenvalue in the covariance matrix S bel + r. Then the 
j.p.d.f. of the eigenvalues in the rank 1 real Wishart spiked model with covariance matrix 
S is given by 

N / \ — i 

where T is a contour that encloses all the points 2{i+t) ■ ■ ■ ' 2(i+t) ^'^ ^^^^ ^'^ oriented in 

the counter-clockwise direction and Zm,n is the normalization constant. The branch cuts 

_ 1 

of the square root (^a — 2{t+i) ^^ ^ ^''^^ chosen to be the line arg(a — 2{t+i) ^) ~ ''^ ■ 

For the purpose of computing the largest eigenvalue distribution P (Amax < 2;), we can 
assume that the eigenvalues are all smaller than or equal to a constant z. 
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4 Skew orthogonal polynomials 

As explain in the introduction, we need to find the skew orthogonal polynomials with the 
weight fll.Sp . Let us denote 2(7+1) t and consider the skew orthogonal polynomials with 
respect to the weight 

We shall use the ideas in [1] to express the skew orthogonal polynomials in terms of a linear 
combinations of Laguerre polynomials. 

Let Hj{x) to be the degree j + 2 polynomial 

Hj{x) = ^ {x^+\t - fx)w{x)) w-\x), j > 0. 

Then as we assume M — > 0, it is easy to see that 

{f{x),H,{y))^ = {f{x),x^)^, (4.2) 
for any /(x) such that f{x)w{x)dx is finite, where the product is defined by 

POO 

{fix)g{x)), = / fix)g{x)wo{x)dx, wo{x) = x^-^e'^^ (4.3) 



Note that Wo{x) is not the square of w{x). The fact that Wo{x) is the weight for the 
Laguerre polynomials allows us to express the skew orthogonal polynomials for the weight 
(14. ip in terms of Laguerre polynomials. 

In particular, this implies that the conditions (ll.lOp is equivalent to the following con- 
ditions 

{T^2k,i,y'), = o, j = o,i, 

(vr2M,l/'>2 = 0, J = 0,...,2A;-3. 

and the exactly same conditions for 7r2fc+i,i(x). In particular, the second condition implies 
the skew orthogonal polynomials can be written as 

7I"2fc,l(x) = L2k{x) + 'j2k,lL2k^l{x) + 'j2k,2L2k-2{x), 

7r2fc+i,i(a;) = L2k+i{x) + ^2k+i,oL2k{x) + -f2k+i,iL2k-i{x) + 72fc+i,2-^^2fe-2(a;), 

where Lj{x) are the degree j monic Laguerre polynomials that are orthogonal with respect 
to the weight wq{x). 

{ _T\n„Mx^-M+N Jn 

L^^x) = ^ > \/ 4- (e-*^-a;"+^-^) , 
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The constants 'jkj are to be determined from the first condition in fl4.4p . We will now show 
that if {L2k-i, L2k-2)i 0, then the skew orthogonal polynomials 7r2fc,i and 7T2k+i,i exist 
and that TT2k,i is unique. First let us show that the first condition in fl4.4p is equivalent to 

{TT2k,l, L2k-j)i =0, j = 1, 2. 

To do this, we will first define a map qn from the span of L2k~i and L2k-2 fo the span of 
y and 1. 

Let P{x) be a polynomial of degree m. Then we can write the polynomial P{x) as 

P(x) = — (q(x)x(t — fx)w(x)) w^^(x) + R(x) (4.6) 
ax 

where q{x) is a polynomial of degree m — 2 and R{x) is a polynomial of degree less than 
or equal to 1. By writing down the system of linear equations satisfied by the coefficients 
of q{x) and R{x), we see that the polynomials q{x) and R{x) are uniquely defined for any 
given P{x). In particular, the map / : P{x) i— )■ R{x) is a well-defined linear map from the 
space of polynomial to the space of polynomials of degrees less than or equal to 1. Let Qk 
be the following restriction of this map. 

Definition 1. For any polynomial P{x), let f be the map that maps P{x) to R{x) in (^7^. 
Then the map Qk is the restriction of f to the linear subspace spanned by the orthogonal 
polynomials Lk,Lk-i. 

We then have the following. 

Lemma 1. // {Lk, Lk^i)-^ 7^ 0, then the map Qk is invertible. 

Proof. Suppose there is exists non-zero constants ai and 02 such that 

ttiLk + a2Lk-i = --^{q{x)x{t — fx)w)w^^ 
ax 

for some polynomial q{x) of degree k — 2, then by taking the skew product ()^ of this 
polynomial with Lk, we obtain 

a2 {Lk-i, Lk)^ = ifliLk + a2Lk-i, Lk)^ = {q{x), Lk)2 = 0. 

As q{x) is of degree k — 2. Since {Lk-i,Lk)i 7^ 0, this shows that 02 = 0. By taking 
the skew product with Lk-i, we conclude that ai = and hence the map Qk has a trivial 
kernel. □ 

In particular, we have the following. 

Corollary 1. If k is even, then {Lk, Lk-i)-^ = 0. 



13 



Proof. Let q{x) be a polynomial of degree k — 2 that satisfies the following conditions 

— {q{x)w4{x))x^W4{x)dx = 0, j = 0, . . . , A; — 2, (4.7) 

where ^4(0;) = 2^^^ {t — fx)^e~^. A non trivial polynomial q{x) of degree k — 
2 that satisfies these conditions exists if and only if the moment matrix with entries 
/r+ ^(2^*'^4(2^))3^'''?^4(3;)da; has a vanishing determinant. For even k, the moment matrix is 
of odd dimension and anti-symmetric and hence its determinant is always zero. 

Assuming k is even and let q{x) be a polynomial that satisfies (14.71) . By taking the 
inner product with x\ we see that there exists non-zero constants ai and 02 such that 

aiLk + a2-C/fc-i = -^(q(x)x(t - fx)w)w^^, 
ax 

Therefore by Lemma [H we see that if k is even, we will have (L^, L^^i)^ =0. □ 

Lemma [T] shows that if 7^ 0, then there exists two independent polynomials 

Ro{y) and Ri{y) in the span of y and 1 such that Rj{y) = Qi{Li^j). Then we have 

Rj{.y) = ^ ry)w)w'^ + Li_j{y), j = 0, 1. 

In particular, the skew product of Rj{y) with Li^i, / < 2 is given by 

{Li_i{x),Rj{y))-^ = - {Li^iqj)^ + {Li_i,Li_j)^ . 

As qj is a polynomial of degree less than or equal to i — 2 and I < 2, the first term on the 
right hand side is zero. Therefore we have 

{L,_i{x),R,iy))^ = {L,_i,L,.j)^, / < 2, j = 0, L (4.8) 

We can now show that the skew orthogonal polynomials TT2k,i and vr2fc+i,i exist if {L2k-i, -^2/1-2) 
0. 

Proposition 4. // (-/^2fc-i; -^2/0-2)1 7^ 0, then the skew orthogonal polynomials T^2k,i one? 
7r2fc+i,i both exist and TT2k,i is unique while TT2k+i,i is unique up to an addition of a multiple 
of 7!'2k,i- Moreover, we have {L2k, L2k-i)i = and the skew orthogonal polynomials are 
given by 

_ J- {L2k, L2k-2)i J 

T^2k.l — ^2k — 77 J T— -t^2fc-l, 

W2fc-1, -tv2fc-2/i 

_ {L2k+l,L2k-2)i J {L2k+l,L2k-l)i J 

7r2fc+l,l — ^2k+l — 77 J ^^2k-l + 77 J ^^2k-2 + CTl2k,li 

\-t>2fc-l, -t>2fc-2/i \J^2k-l, J^2k-2/i 

for k > 2, where c is an arbitrary constant. 
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Proof. Let 7T2k,i and 'n:2k+i,i be polynomials defined by 

'^2k,l{x) = L2k{x) + 'y2k,lL2k-l{x) + l2k,2L2k-2{.x), 
T^2k+l,l{x) = L2k+l{x) + ^2k+l,lL2k-l{x) +^2k+l,2L2k^2{x), 

for some constants •jj^k- If we can show that (vr2fc_/,i, y-')^ = for j = 0, 1 and / = —1,0, 
then TT2k-i,i will be the skew orthogonal polynomial. Let Rq and Ri be the images of 
L2k-i and L2k-2 under the map g2k-i- Then by the assumption in the Proposition, they 
are independent in the span of y and 1. Therefore the conditions {7r2k-i,i,y'^)i ~ ^ 
equivalent to {7!'2k-i,i, Rj{y))i = 0. By taking i = 2k — 1 in fl4.8p . we see that this is 
equivalent to {'n'2k-i,i, L2k-i-j)i = 0. This implies 

{T!'2k,l, L2k-l)i = {L2k, -^2fc-l)i + 72fc,2 (-^2fc-2, -^2A:-l)i = 0, 

(7r2A:,l, -^2fc-2)i = (-^2A: , -^2A:-2) i + 72fc,l (-^2fc-l , -^2A:-2) i = 0. 

Hence we have 

_ {L2k,L2k-2)i _ {L2k,L2k~l)i 

l2k,l — —77 7 ^, 72fc,2 — 77 7 ^, 

W2A:-1, -t^2fc-2/i W2fc-1? -t^2fc-2/i 

which exist and are unique as (i^2fc-i, -^2/c-2)i 7^ 0. This determines 7i2k,i uniquely. By 
Corollary [H we have {L2k, L2k-i)i = and hence 72^,2 = 0. Similarly, the coefficients for 

7r2fc+i,i are 

_ {L2k+1, L2k-2)i _ {L2k+1, L2k-l)i 

72fc+l,l — —77 7 ^, 72fc+l,2 — 77 J ^• 

\^2k-li J^2k-2li W2fc-1? -^2/c-2/i 

Again, these coefficients exist and are unique. However, as (vr2fc,i, vr2fc,i)-^ = and {T^2kA,y^)i = 
for j = 0, . . . , 2fc — 1, adding any multiple of T^2k,i to T^2k+i,i will not change the orthog- 
onality conditions {'K2k+i,i,y^) i = that is satisfied by 7r2A;+i,i and hence n2k+i,i is only 
determined up to the addition of a multiple of 7i2k,i- □ 



5 The Christoffel Darboux formula for the kernel 

In [26], skew orthogonal polynomials were interpreted as multi-orthogonal polynomials and 
represented as the solution of a Riemann-Hilbert problem. This representation allows us to 
us the results in |15] to derive a Christoffel-Darboux formula for the kernel (11. 9p in terms 
of the Riemann-Hilbert problem. 

Let us recall the definitions of multi-orthogonal polynomials. First let the weights Wq, 
wi and W2 be 

woix) = x*^-^e-^^ wi{x) = w{x) [ e{x - y)Lr,^i^2{y)w{y)dy, / = 1, 2. 

Note that the weights wi{x) are defined with the polynomials L^v-s and LAr_4 instead of 
L7v_i and Ln~2- This is because the construction below involves the polynomial 1^^-2,1 as 
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well as 7iN,i- By taking i = N — 3 in (14.81) . we see that the orthogonality conditions for 
ttat^i is also equivalent to 

{n^,i,x^)^ = 0, j = 0,...,N-3, 
(7rjv,i,i^7v-i)2 = 0, j = 3,4, 

provided (L7V-3, i^Ar-4)i is also non-zero. 

Then the orthognoal polynomials of type II P^^i{x), [2], [3], [9], [16] are polynomials of 
degree — 1 such that 

/ P^\{x)x^wo{x)dx = 0, < J < AT - 3, 

' (5.1) 
Pj(/;(x)t(7m(x)dx = -27ii6ijn, l,m= 1, 2. 



Remark 2. More accurately, these are in fact the multi- orthogonal polynomials with indices 
{N — 2, q), where e\ = (0, 1) and 62 = (1, 0). 

We will now define the multi-orthogonal polynomials of type I. Let P^i{x) be a function 
of the following form 

2 

Pn,i{x) = Bn^i{x)wo + {Skix + AN^k,i) Wk, (5.2) 

k=l 

where Bn^i{x) is a polynomial of degree — 3 and A^^k,! independent on x. Moreover, let 
P^i{x) satisfies 

P^^i{x)x^dx = 0, J = 0, . . . , AT - 1. 

Then the polynomials Bnj{x) and 6kix + A^^k,! are multi-orthogonal polynomials of type 
I with indices (A^, 2, 1) for Z = 1 and (A^, 1, 2) for / = 2. We will now show that Pj/^ and 
Pl/2 exist and are unique if both {L^-i, Liy^2)i and (Ljv_3, Ljv_4)-^ are non-zero. 

Lemma 2. Suppose both {L^-i, Ln_2)i and {L^s, Ln-4)i are non-zero, then the polyno- 
mials P^\ and Pl/2 exist and are unique. 

Proof. Let us write Ln_i as 

Ln-i = -7- {qi{x)x{t - fx)w)w~'^ + Ri{x), / = 1, . . . ,4. 
ax 

for some polynomials qi of degree N — l — 2 and Ri of degree 1, then by Lemma [H we see that 
both Qn-i and Qn-s are invertible and hence the composition Qn-iQn^s is also invertible. 
In particular, there exists a 2 x 2 invertible matrix with entries ci^k and polynomials qi of 
degree A^ — 3 such that 

Ln_1 = iqiix)x{t - fx)w) W'^ + Q_2,livjv_i + Q_2,2^7V-2, / = 3, 4. 
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Then by the first condition in (15. II) . we see that 

/ P^liWj{x)dx = (P^,, Q,iLAr_i + Q,2^7v-2)i = -'2ni5ij, 1 = 1,2, j = 1,2. (5.3) 

As the matrix with entries Cij is invertible, we see that the hnear equations (15. 3 p has a 
unique solution in the hnear span of L^-i and Ln~2 if and only if {L^-i, Ln-2)i 7^ 0. □ 

As we shall see, existence and uniqueness of P^^i would imply that the multi-orthogonal 
polynomials of type I also exist and are unique. As in [26], the multi-orthogonal polynomial 
together with the skew orthogonal polynomials form the solution of a Riemann-Hilbert 
problem. Let Y{x) be the matrix 



Y(x) 



( -KN^lix) C{-nN,lWo) C{'Kn,iWi) C{'Kn,iW2) \ 



\ 



(5.4) 



where n is the constant 



2m 



Ani 



and C{f) is the Cauchy transform 



fMh 



1-2 j 



J 



-1,1 — {'^2j-2,l,'^2j-l,l)i 



C{f){x) = — 



fis) 



■ds. 



s — X 



(5.5) 



(5.6) 



Then by using the orthogonality conditions of the skew orthogonal polynomials and multi- 
orthogonal polynomials, together with the jump discontinuity of the Cauchy transform, 
one can check that Y{x) satisfies the following Riemann-Hilbert problem. 



1. y{z) is analytic in C \ IR+, 

[1 Wo Wi{z) W2{z)\ 

2. YAz)=Y(z) 



1 

\0 




1 







1 / 



z e 



(5.7) 



3. Y{z) = {I + Oiz-')) 



v 



-N+2 



v-1 



v-1 



Z — )■ OO. 



The multi-orthogonal polynomials of type I can also be arranged to satisfy a Riemann- 
Hilbert problem. Let e be the operator 



1 

2 Jo 



eix -y)f{y)dy. 
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First note that the functions ipj{x) = e{7ij^iw) for j > 2, can be express in the form of 
f l5.2p . By Lemma [H we can write 7!'j,i{x) as 



d_ 

dx 



{Bj{x)x{t - Tx)w) W ^ + y4j_iLAr_3 + Aj^2LN-4, 



Then we have 



e{7Tj^lW)w = Bj{x)Wo + Aj^iWi + Aj^2'W2- 



(5.9) 



where Bj{x) is a polynomial of degree j — 2. 

Let X{z) be the matrix value function defined by 



X{z) 



ktM a 
2 — 2~^Ar-2,l 



B, 



ktM 



fM R 



fM A 



2 ^iV-2,2\ 
2 



rM A 



(5.10) 



/ 



Then by using the orthogonality and the the jump discontinuity of the Cauchy transform, 
it is easy to check that X~'^{z) and Y{z) satisfies the same Riemann-Hilbert problem and 
hence the multi-orthogonal polynomials of type I also exist and are unique. 

We will now show that the kernel 5*1(0;, y) given by (II. 9p can be expressed in terms of 
the matrix Y{z). 

Proposition 5. Suppose {Ljy^^, Liy^4)^ {L^-i, Ln~2)i 7^ and let the kernel Si{x,y) be 



N-l 



Si{x,y) = - ^ rj{x)w{x)iJ,jke{rkw){y), 

j,k=0 



(5.11) 



where rj{x) is an arbitrary degree j monic polynomial for j < N — 2 and rj{x) = iij^iix) 
for j > N — 2. The matrix /i with entries is the inverse of the matrix M. whose entries 
are given by 

{M)^^ = {rj,rk)^, j,k = 0,...,N-l. (5.12) 
Then the kernel Si{x,y) exists and is equal to 



5i(a:,2/) = ^^|^|^^(0 woiy) wM W2{y))Y-\y)Y^{x) 



/1\ 





\V 



(5.13) 



Proof. First note that, since (L7V-1, -Z^Ar-2)i 7^ and (L^r-s, Ljv_4)-^ 7^ 0, the skew orthog- 
onal polynomials t^n-i,! exist for / = —1, . . . , 2. In particular, the moment matrix M. with 
entries 



M 



■j 1,'' 



jk 



y^)^, j,A; = 0,...,iV-l 
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is invertible. Since the polynomials t^n-j,! exist for j = —1, . . . , 2, the sequence rk{x) and 
are related by an invertible transformation. Therefore the matrix Ai in f l5.12p is also 
invertible. As the matrix Ai is of the form 

( o' /ijv-i,i:r)' (-1 

where A^2 has entries {rj, r^)^ for j, k from to — 3. From this, we see that the matrix 
fijk is of the form 

"=(0 j- 

As in [15], let us now expand the functions xrj{x) and xe{rjw). 

N-l 

xrj{x) = ^ CjkTkix) + 5jv-ij7rjv,i(x), 

fc=0 

xe{rjw){x) = djke{rkw) + dj^N-ipN + dj^N+i ^' A ^ + dj,N+2 

k=0 ^ ^ ^ ^ 



(5.15) 



Then the coefficients Cjk and (ij^ for j, = 0, . . . , A^ — 1 are given by 

N-l N-l 



=0 i=0 



Therefore if we let C be the matrix with entries cjk, j, k = 0, . . . N — 1 and V be the matrix 
with entries djk for j, = 0, . . . A^ — 1, then we have 

C = Mifi, V = {^iMif, (5.16) 

where M.i is the matrix with entries {xrj,rk)^ for j,k = 0, . . . , N — 1. From fl5.15p . we 
obtain 

N-l 



{y-x)Si{x,y) = ^nN,ii^)w{x)iJ,N-i,je{rjw) (y) 



j=0 

N-l 



> , rj{x)w{x)fijk dk,NWN[y> + dk,N+l jr^ + Cifc,Af+2- 



+ r"^(x)w(x) (C^ jJ. — fiV) e{rw){y), 



w{y) ' w{y) 



where r{x) is the column vector with components rk{x). Now by fl5.16p . we see that 
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which are equal as fi^ = — /i. Now from the form of in f l5.14p . we see that fJ^N-ij = 
5j,Ar-2^jv-i 1- Hence we have 

7V-1 

^ ■KN,i{x)w{x)fiN^i,je {rjw) (y) = hJf^_^^^nj^^i{x)w{x)i!N-2iy)- (5.18) 

j=0 

Let us now consider the second term in fl5.17p . As in (15. 9p we can write e{rkw)w as 

e{rkw)w = qk{x) + Dk,iWi + Dk,2W2, 

Then from the form of j in (15. 2 p and the orthogonahty condition (15. ip . we see that the 
coefficients dk,N+i, I = 1,2 are given by 



dk,N+i = Dk,i = -TT- / Pili{x)e{rkw)wdx. 



For k N — 1, the polynomial qk is of degree less than or equal to — 4, while Bn is a 
polynomial of degree N — 2, therefore the coefficient dk^N is zero unless k = N — 1. For 
= — 1, it is given by the leading coefficient of Qn-i divided by the leading coefficient 
of -Bat. Since 

7rAr_i,i(x) = ^ {qN-lix)x{t - fx)w) W'^ + DkALN-3 + Dk,2LN~A, 

we see that both the leading coefficient of qN-i{x) and Bjy is Hence d^^N is S^^n-i- 
This gives us 

^ rj{x)w{x)fljkdk,Ni^N{y) = -h]^\^TTN-2,lix)w{x)i!Niy)- 
k,j=0 

To express the second term in (I5.17P in terms of the multi-orthogonal polynomials, let us 
now express P^/i in terms of the polynomials r^. Let us write P^/i = Ylf=o cbj^j{x)- Then 
we have 

N-l N-1 „ 

PN,i{x)e{rkw)wdx = ^ aj {Mi)^^ , ^ / P^^i{x)e{rkw)wdxnkj = aj. 
Hence P^^i{x) can be written as 

N-l ^ „ X N-l 

Pn,i{^) = ^ [ PN^i{x)e{rkw)wdxfikjj rj{x) = -2^ ^ dk^^+ifJ'kj 
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Tj [X ) 



Therefore the second term in fl5.17p is given by 



N-l 



j,k=0 



w{y) 



w{y) 



1 ^ 
1=1 



From this and (15.181) . we obtain 

(y - x)Si{x,y) = /i^^_i^i7rAr,i(x)w(x)V^Ar_2(y) + h~^_^^^nN^2,iix)w{x)^N{y) 



1=1 



By using the fact that Y ^{y) = X'^{y) and the expressions of the matrix Y (15. 4p and X 
(15.101) . together with (15. 5p . we see that this is the same as (I5.13p . □ 



5.1 The kernel in terms of Laguerre polynomials 

We will now use a result in |6j to further simplify the expression of the kernel Si{x,y) 
so that its asymptotics can be computed using the asymptotics of Laguerre polynomials. 
Let us recall the set up in [B]. First let Y{x) be a matrix satisfying the Riemann-Hilbert 
problem 

1. Y{z) is analytic in C \ M+, 

fl Wq{z) Wi{z) ■■■ Wr{z)\ 

■■■ 



2. YUz) = Y(z) 



1 



z e 



3. Y{z) = {l^O{z-')) 



-n.+r 



v 



2; — 7- oo. 



■7 



and let ICi{x,y) be the kernel given by 

Wo{x)wQ^{y) 



/Ci(x,2/) 



2iTi{x — y) 



(0 wo{y) ... Wr{y))Y-\y)Y4x) 







(5.19) 
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Let vrj_2(x) be the monic orthogonal polynomials with respect to the weight wq{x). Let 
)Co{x, y) be the following kernel. 

ICo{x,y) = wo{x) , (5.20) 

K~i,2[x - y) 

where hj^2 = /o°° ^j,2'"^odx. Let 7r(z), v{z) and u{z) be the following vectors 

7r(2:) = (7r„_r,2, • • • , 7r„_i,2) , v{z) = {wi, . . . ,Wr) Wq , u{z) = [I - }Cq) v{z) (5.21) 

and let B be the matrix B = 7r{z)v'^ {z)wo{z)dz. Then the kernel ICi{x,y) can be 
express as [6j 

Proposition 6. Suppose J^^^ p{x)wi{x)dx converges for any polynomial p{x). Then the 
kernel }Ci{x,y) defined by /i5.19\) is given by 

K:,ix,y) - /Co(x,y) = woix)u^iy)B-'7Tix). (5.22) 

Remark 3. Although in 16], the theorem is stated with the jump ofY{x) on M instead of 
M+, while the weights are of the special form wq = e~^^^^\ "^ji^) = e"^^, where V{x) is 
an even degree polynomial, the proof in [6] in fact remain valid as long as integrals of the 
form J^^p{x)wi{x)dx converges for any polynomial p{x) . This is true in our case. 

We can now apply Proposition [6] to our case. In our case, the vectors tc{z) and v{z) are 
given by 

n{z) = {Ln-2 Ln-i)^ , v{z) = (wi W2)'^w^^, 
while the matrix B is given by 



B 



By corollary [H we see that {L]^^2^L^_-i)-^ = and hence the determinant of B is 

det B = {Ln^2, Ln-a)i {L^-i, Ln~3)i ■ 

From Lemma [21 we see that B is invertible if and only if the multi-orthogonal polynomials 
P^^i exist. Let us now consider the vector u{z). It is given by 

N-l J , . 

u{z) = {I- Kl) v{z) = v{z) -Y.^ {{L„L^-s), (L,,L^_4) J 

by the Christoffel-Darboux formula, where Hj^q = {Lj,Lj)^. We shall show that I/Ar_3 and 
LAr_4 can be written in the following form 

Ln~1 = {qi{x)x{t - fx)w) W^'^ + C;„2,l7rAr+i,i + Ci-2,2TTn,1, ^ = 3, 4, (5.23) 
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for some polynomial qi{x) of degree A^ — 1. By Lemma[Tl we see that if {L^^^, Ln-4)i 7^ 0, 
then the map Qn-'a in Definition [1] is invertible. Therefore if the restriction of the map / 
in Definition [1] is also invertible on the span of vtat+i^i and vttv,!, we will be able to write 
Ln_^ and LAr_4 in the form of fl5.23p . 

Lemma 3. Let f be the map in DefinitionUl and let g^^ be its restriction to the span of 
ttat+i^i andiiN,!- Then Qt, is invertible. 

Proof. Suppose there exist ai and 02 such that 

cuttat+i 1 + a2'^N 1 = -7- (q(x)x(t - fx)w) w^^ 
ax 

for some polynomial q{x) of degree at most — 1. Then we have 

{x^ ,aiiTN+i,i + a27iN,i)^ = {x^q{x))^ = 0, j = 0, . . . , - 1. 

As the degree of q{x) is at most A^ — 1, this is only possible if = 0. □ 

The composition of QN-'i and will therefore give us a representation of -L^v.s and 
LAr_4 in the form of (15.231) . By using this representation and the fact that qi{x) is of degree 
at most A^ — 1, we see that 



Therefore the vector u{x) is given by 

u{x) = w{x)'WQ''{x)Ce{T(N+l,lW 71^,1^)^ 

where C is the matrix with entries Ci^. We will now determine the constants Cij. 

Lemma 4. Let t^n,! ond vr^v+i,! be the monic skew orthogonal polynomial with respect to 
the weight w{x) and choose ttn+i,! so that the constant c in Iji4-^ is zero. Then the vector 
u{y) in 115. 22^) is given by 





u{x) = w{x)wq ^{x)Ce (vtat+i^iw 
where C is the matrix whose entries Cij are given by 

_ Mf {LN-l,LN-i-2)i 




itn,iw) 



(5.24) 



2/iAr-2,0 



(5.25) 



■N-1,0 
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Proof. First let us compute the leading order coefficients of the polynomial qi{x) in fl5.23|) . 

Let qi{x) = qi^N-iX^~^ + qi,N-2X^~'^ + 0(x^~^), then we have 

^ / / \ / ~ \ \ —1 -A^7~ N'-\-^ 
— [qi[x)x[t - Tx)w) w =^—qi^_^x ^, 
ax 2 

From fl5.23p . we see that 

2 

qi,N-i = ~J^^i-2,i- (5-26) 
On the other hand, by orthogonality, we have 

{Ln~1, Ln-i)i = {LN-l,qi)2 = qi,N-lhN-lfl- 

Therefore C;_2,i is given by 

Mf {Ln-i,Ln-i)i 



a- 



-2,1 



2/iAr-l,0 

Let us now compute Cj_2- By taking the skew product, we have 

(Ljv„2) -^Af-«)i = qi,N-l {Ln-2, + 'll,N-2hN-2fl 

Now from fl4.5p . we obtain 

(a;-'"^\ Lj)^ = (^Lj+i + - ^— -x\ , 

_ (M-iV + j + l)(j + l) 



(5.27) 



M 

Hence qi,N-2 is equal to 

{Ln-2,L^-i), ^ (M-l)(iV-l) 

Q^i,Af-2 = 7 g«,Ar-l TT (5.28j 

'lN-2,0 M 

By using the expansion (14.91) of the skew orthogonal polynomials in terms of L]\i_k, we 
have 

+ I 2 ~ M)qi^N~i ^-y^iv-i + -i^qi,N-2 1 Vo 

By substituting (15.281) into this, we obtain 

Q_2.2= f--(M + iV) + ^'^^ (L^_2,L^_z)i 



V 2 2 / hN-ifl 2 hN-2,0 

This proves the lemma. □ 
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From this and (15.221) . we obtain the following. 
Corollary 2. The kernel Si{x,y) defined by 115. is given by 
Si{x,y) - K2{x,y) = 







e(7rAr+i,iw TTN,iw){y)[ Mt-fiN+M) | Tr{x)w{x) 



(5.29) 



2/lA 



2/1 A 



where K2{x,y) is the kernel of the Laguerre polynomials 



x{t — fx) 



hN-ifl{x - y) 



(5.30) 



6 Derivative of the partition function 



In this section we will derive a formula for the derivative of determinant of the matrix M. 
given in (I5.12p . We have the following. 



Proposition 7. Let M. be the matrix given by \5.12^) . where the sequence of monic poly- 
nomials rj{x) in \5.12\) is chosen such that rj{x) are arbitrary degree j monic polynomials 
that are independent on t and rj{x) = 7ijA{x) for j = N — 2, N — 1. Then the logarithmic 
derivative of det with respect to t is given by 



d 



log det M 



Si{x, x) 



dx, 



dt ^ Jw: t — TX 

where Si{x,y) is the kernel given in i\5.11\) . 

Proof. First let us differential the determinant det Ai with respect to t. We have 



(6.1) 



— det = det 
dt 



+ det 



/ dtM, 



00 



01 



\dtM2n-l,0 M2„_i,i 

/ Moo dtMol 



n— 1,1 

/ Moo Moi 
H h det : : 

\Mn -1,0 Mn-i,\ 



Mo,jv-i \ 



Mn~i,n-i ) 

■ dtMo,N-i \ 

■ dtMN-l,N-l J 



Computing the individual determinants using the Laplace formula, we obtain 

N-l 



d 

— detM = det M ^ dtMijfiji. 

i,j=0 



(6.2) 
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As rj{x) are independent on t for j < N — 2, the derivative dtMij is given by 
for i,j<N — 2. For either i or j equal to — 2 or iV — 1, we have 

dtMi N_l = 6N-2.i\ - - ( ( 7'"Af-l,l ) - ( !'\ 7rjv_2,l 

2\\t — rx Z-,^ \t — TX 

+ {dt-KN-2,l,T^N-l,l)i + (7rAf-2,l, f^t7rAr_i,i)^ . 



Note that by orthogonahty, the last two terms in the above expression are zero as dt'nN-i,! 
is of degree N — 2 and dtTiN-2,i is of degree A^ — 3. Applying the same argument to dtMi^N_2, 
we obtain 

a X (I \ / ttat-i,! 

OtMi N-l = ~0N-2,i \ —,T^N~-l,l ) - \ —,T^N-2,1 

\\t — TX I ^ \t — TX 

a ^N-l,i [ I TTtV-I,! \ / T^N-2,\ 

dtMi^N-2 = — ( z — —,^N-2,i ) - { z —,ttn-i,i 

2 \\t — TX I ^ \t — TX 

As M. is anti-symmetric, the derivatives dtM]^_x^i and dtM^_2^i are given by dtM^-i^i = 
— (9iMj jv_i and dtM]y_2^i = —dtMi^N-2- From these and fl6.2p . we obtain 

-detA4 = detA4 $:^^,r,^ 

^''=' ' (6.3) 

+ 2 ( (^^>^iV-l,l)^ - Q^,n^-2,l)] f^N-2,N-l], 

where we have used the anti-symmetry of Ai and to obtain the last term. From the 
structure of the matrix /i in fl5.14p . we see that the last term in (16. 3p can be written as 

TTN-2,1 \ I T^N-\,\ 

t — TX I ^ \t — TX I ^ 

i=0 j=N-2 ^ ' 1 i=N-2 j=0 ^ ' 1 

From this, (16. 3p and the expression of the kernel in (15. lip , we obtain (16. ip . □ 
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Appendix: A proof of the j.p.d.f. formula using Zonal 
polynomials 

We present here a simpler algebraic proof of Theorem [T] using Zonal polynomials. Zonal 
polynomials are introduced by James [20] and Hua [18] independently. They are polyno- 
mials with matrix argument that depend on an index p which is a partition of an integer 
k. The real Zonal polynomials Zp{X) take arguments in symmetric matrices and are ho- 
mogenous polynomials in the eigenvalues of its matrix argument X. We shall not go into 
the details of their definitions, but only state the important properties of these polyno- 
mials that is relevant to our proof. Readers who are interested can refer to the excellent 
references of [25], [22] and |27] . 

Let p be a partition of an integer k and let l{p) be the length of the partition. We 
will use p \- k to indicate that p is a partition of k. Let X and F be x symmetric 
matrices and Xj, yi their eigenvalues. Given a partition p = (pi, . . . ,pi(p)) of the integer k, 
we will order the parts pi such that if i < j, then pi > pj. If we have 2 partitions p and 
p' = {p'l, . . . then we say that p < p' if there exists an index j such that pi = p\ for 

i < j and pj < p'j. Let the monomial be . . . XpJ|pj, then we say that x^' is of a higher 
weight than x^ if p' > p. Then the Zonal polynomial Zp{X) is a homogenous polynomial of 
degree k in the eigenvalues Xj with the highest weight term being x^. It has the following 
properties. 

{tT{X))' = J2Zp{X), 

p\-k 

These properties can be found in the references [25], [22] and [27]. Another important 
property is the following generating function formula for the Zonal polynomials, which can 
be found in [22j and ^27]. 

i,j=l k=0 phk ^ 

for some constant dp. In particular, if (k) is the partition of k with length 1, that is, 
(k) = {k,0, . . . ,0), then the constant d(^k) is given by 

, 1 

(2A;-1)!!- 

For the rank 1 spiked model, let us consider the case where all but one yj is zero and denote 
the non-zero eigenvalue by y. Then from the fact that the highest weight term in Zp{Y) 
is yi^ . . -yplll], we see that the only non-zero Zp{Y) is which by the first equation 
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in flA.l|) . is simply y^. Therefore the formulae in flA.l|) and flA.2|) are greatly simplified in 
this case. 



Jo{N) ^ k\Z(k)[l 



IO{N) —Q i^.'.z.(k){lN)' 

1=1 k=0 

By using the generating function formula, we see that Z(^k){lN) is given by 

(iV/2 + A; - 1)!2'= 



Z(k){lN) 



{N/2-l)l{2k-l)\\' 



By taking 6* = ^ in the second equation of flA.3|) . we see that 



i=l k=0 



We can now compute the integral 



S{t)= / e^''\\{t-x,y)-Ut 

i=i 



by taking residue at oo, which is the t ^ coefficient in the following expansion 



N 



i=l 



MH-'i+^-\2k-l)\\Z(u){X)y 



This coefficient is given by 

oo 



N , ^ Z(fc)(X)(2A;-l)!!y^M^ 
2^'(A^/2 + A;-l)!A;! 



k=0 



(Ar/2-1)!^ ^(fe)(/7v)A:! (Ar/2 - 1)! 



-MytriXgYg^ 



(A.3) 



(A.4) 



0(N) 



This proves Theorem [TJ There also exist complex and quarternionic Zonal polynomials 
Cp{X) and Qp{X) which satisfy the foUowings instead. 



I e~^^y''^^^^^^)g'dg = V ^^^^^ V 



k=o ^' U Cr>{lN) 



I (,-MyTle{tv{XgYg-^)) g-l^g ^ (My) 

Jsp{N) Tl^r. ^' 4^ 



{Myf ^ Qp(X)Qp(r) 
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Their generating functions are given by 



i,j=l k=0 phk ^ 

N 



i 

where C(fe) and are 



i,j=l k=0 phk 



1 



Then by following the same argument as in the real case, we can write down the following 
integral formulae for rank one perturbations of the complex and quarternionic cases. 



JU{N) Jv -^^ 

JSp{N) J-VJ- Jt ^1 



(A.5) 
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